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Abstract 

Evolutionarily stable strategy (ESS) is a key concept in evolutionary 
game theory. ESS provides an evolutionary stability criterion for biologi¬ 
cal, social and economical behaviors. In this paper, we develop a new ap¬ 
proach to evaluate ESS in symmetric two player games with fuzzy payoffs. 
Particularly, every strategy is assigned a fuzzy membership that describes 
to what degree it is an ESS in presence of uncertainty. The fuzzy set of 
ESS characterize the nature of ESS. The proposed approach avoids loss 
of any information that happens by the defuzzification method in games 
and handles uncertainty of payoffs through all steps of finding an ESS. 

We use the satisfaction function to compare fuzzy payoffs, and adopts the 
fuzzy decision rule to obtain the membership function of the fuzzy set of 
ESS. The theorem shows the relation between fuzzy ESS and fuzzy Nash 
equilibrium. The numerical results illustrate the proposed method is an 
appropriate generalization of ESS to fuzzy payoff games. 

Keywords: Fuzzy set, game theory, evolutionarily stable strategy, Nash equi¬ 
librium. 


1 Introduction 

The general problem of how to make decisions plays an important role in eco¬ 
nomics, biology, political science, computer science and etc. Generally in real 
life problems, there are several decision makers who affects the actions of the 
others. Game theory is the study of mathematical models of conflict and coop¬ 
eration between rational decision-makers. A normal game consists of a set of 
players (decision makers), their strategies (actions), and payoffs available for all 
combinations of the players’ strategies. Classical game theory mm deals with 
rational players that are engaged in a game with other players. Each player has 
to decide among his strategies in order to maximize his payoff, which depends 
on the strategies chosen by other players who in turn try to maximize their 
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payoffs. However, rationality is generally a strong assumption imposed to real 
world scenarios. As a result, evolutionary game theory J3Jj3] (EGT) deals with 
a population of players, in which players are not assumed to play rationally, 
with rationality replaced by evolutionary stability. The players in EGT are re¬ 
peatedly drawn from a random infinite population to play the game. The aim 
is to study the evolution of the different strategies in the population according 
to a behavioral pattern. 

The main concept in EGT is that of an evolutionary stable strategy (ESS) 
[5] describing the stable state of a population resulting from dynamics of evo¬ 
lution. Such a strategy is robust to evolutionary selection forces in an exact 
sense. Initially all individuals play the same incumbent strategy, then a small 
population share of individuals who play some other mutant strategy is injected. 
The incumbent strategy is said to be an ESS, if for each mutant strategy, there 
exists a positive invasion barrier such that if the population share of mutants 
falls below this barrier, the incumbents earns a higher expected payoff than the 
mutants. Consequently incumbents have no incentive to change their strategy, 
and the mutants have an incentive to return to the incumbent strategy. 

To use game theory methods in real world problems, the exact values of 
the payoffs should be known. However, since the players usually encounter 
uncertainties and their information is incomplete, the crisp values of the payoffs 
are usually unknown. Hence the need arises as to study the games with uncertain 
payoffs. A way to deal with uncertainties associated with payoffs is to use the 
concept of fuzzy sets. Initially, fuzzy sets were introduced by Butnariu mm 
in non-cooperative game theory to model fuzzy games. Many studies on fuzzy 
game theory have been reported in the literature isnsuDunmaEiiia. The 
readers can refer to m for the survey on fuzzy game theory. However, to the 
best of our knowledge, there isn’t any study reported dealing with uncertainties 
in EGT. Particularly, in this paper, we propose the concept of Fuzzy ESS in 
symmetric two player games with fuzzy payoffs. In this regards, instead of 
answering whether a strategy is an ESS or not, each strategy is assigned a 
membership that describes the degree to which it possess the characteristics of 
ESS. The idea of fuzzy ESS captures the nature of ESS in a fuzzy payoff game, 
and can be considered as a refinement of fuzzy Nash equilibrium proposed in 
on na na m ng. Specifically, we show that the fuzzy set of ESS is a subset 
of the fuzzy set of Nash equilibrium in symmetric two player games. 

The remainder of this paper is organized as follows. Section [2] reviews the 
related concepts in EGT. The proposed approach to evaluate ESS in games 
with fuzzy payoffs is introduced in this section. It also contains the relation 
between the proposed fuzzy ESS and the fuzzy Nash equilibrium. In section 
[3j we illustrate the proposed method by simple examples with small number of 
strategies. In section [J concluding remarks are given and main findings of the 
paper are highlighted. 
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2 Evolutionary Stable Strategies: A Fuzzy Gen¬ 
eralization Scheme 

A normal game consists of a set of players, their strategies, and the payoffs 
available for all combinations of players strategies. A strategic game G can be 
defined as 

= (1) 

where N = {1,... ,n} is the set of n players, ,S',; denotes the set of strategies 
available to the ith player and $j : }{ JgJV t ® is the payoff function of the 
zth player dljejv i s the set °f a ii possible combination of strategies). In 
economics, the payoffs are usually firms’ profits or consumers’ utilities, while in 
biology, payoffs usually represent individual fitness. 

For a symmetric two-player game, i.e. N = {1,2}, the two players have the 
same strategy set S = {si, S 2 , ■ ■ ■, S|s|}, namely S\ = S 2 = S, where IS} denotes 
the cardinality of S. For any i,j £ {1,2,...,|S|}, the payoff for the player 1 
playing Sj facing the oponent playing Sj is the same as the payoff for the player 
2 playing Si facing the oponent playing Sj, i.e. $i(sj, Sj) = % 2 (sj, Sj). Hence the 
payoffs of the both players can be described using the same function $. If the 
player 1 plays Sj and the player 2 plays Sj, the payoffs are $(si, Sj) to Player 1 
and $(sj, Si) to Player 2. Thus a symmetric two-player game G can be defined 

by 

G = (S, $). (2) 

where $ can be represented by a |S| x |S| payoff matrix. 

For the simplicity of the notation, in the remainder of this paper, the index of 
a strategy is used to represent the strategy itself. For instance, $(£, j) represents 
$(s.;, Sj). 

2.1 Evolutionarily Stable Strategy 

In this subsection, we review briefly the main concepts and definitions in EGT. 

Definition 1 [3]: For a symmetric two-player game G, a strategy s,; € S is 
an ESS if for every j ^ i, there exists £ (0,1) such that 

(l-e)-S (i,i)+e-$(i,j) > (1 - e) • $(j, i) + e ■ (3) 

holds when e £ (0 ,£ij). 

Suppose that a population of individuals that plays strategy Sj, is invaded 
by a group of mutants that play the alternative strategy Sj. Equation [3] requires 
that regardless of the choice of S j. an incumbent’s expected payoff (left hand side 
of the inequality) from a random match in the post-entry population exceeds 
that of a mutant (right hand side of the inequality) so long as the size of the 
invading group e is smaller than the invasion barrier £ij. A lower invasion 
barrier means that the population is more vulnerable to invasion, while a higher 
invasion barrier means that the population is more stable. 
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For instance, consider the Prisoner’s Dilemma game that is a well-known 
symmetric 2x2 game, representing the conflict between individual rationality 
and social optimality. For this game, S = {(7, D}, where C denotes “Cooperate” 
and D denotes “Defect”. The payoffs satisfy $(_D,C) > $((7,(7) > %(D 1 D) > 
$((7, D ). According to definition 1, one can show that the strategy D is an ESS. 
Hence, a player tends to defect rather than to cooperate. 


2.2 Fuzzy Evolutionarily Stable Strategy 

In this subsection, we generalize the ESS in games with fuzzy payoffs. In par¬ 
ticular, a symmetric two-player game with fuzzy payoffs is similar to crips one 
except that the payoffs are fuzzy numbers, i.e. 

G = {S~§). (4) 

where $ shows the set of fuzzy payoffs. 

When the payoffs are not crisp values, the expected payoffs for the players 
have uncertainties. In this regard, the expected payoff of an incumbent playing 
strategy i against a mutant playing strategy j is a fuzzy number 

Ej J (e) = (1 -e) • $(*,*)+£• (5) 

Similarly, the expected payoff for the mutant is 

Em(s) = (1 — e) • $(j, i) + e ■ (6) 

Now, to compute the fuzzy expected values for the players, the multiplication 
and addition can be done using the extension principle [20] : 

^x-a(x) = ha(j), (7) 

Ha+b(z)= sup n B {y)), (8) 

x+y—z 


where A, B are fuzzy numbers, and Agl\ {0}. 

However, the question is how to compare fuzzy expexted payoffs. There are 
several different methods for comparing possibilistic distributions in the context 
of fuzzy set theory. In this paper, in order to compare fuzzy numbers Ef 1 (e) and 
-®m( £ ), we used the satisfaction function [21]. The satisfaction function is the 
truth value for comparison between fuzzy values. In particular, the satisfaction 
function for the comparison between fuzzy values A and B is defined as 


f-oo f-oo Va{x) © VB{y)dxdy ’ 
cp( a . m = f-oo f-oo X ) 0 ys(y)dxdy 

1 j fZfZ»A(x)Q» B (y)dxd y ’ 


(9) 

( 10 ) 
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where 0 is a T-norm operator that can be the min operator, multiplication, and 
etc. In this paper, we use multiplication operator as the T-norm to simplify the 
calculations. 

SF{A > B) represents the possibility that A is larger than B, while SF(A < 
B) represents the possibility that A is smaller than B. Clearly, SF{A > B) + 
SF{A <B) = 1, and SF(A > A) = 0.5. 

Although some restrictions on A, B are necessary [21] . most types of fuzzy 
sets in different applications, such as triangular and trapezoidal, satisfy the 
imposed restrictions. 

Now, by using the satisfaction function, the following relation represents the 
degree to which Equation [3] is satisfied 

mf SF(Ey(e)>E%(s)). (11) 

£G(0,£) 


In addition, by applying Bellman and Zadeh’s fuzzy decision rule [22] , we de¬ 
fine the degree of resistibility of s t against Sj as the supremum of the intersection 
of fj,ij and the invasion barrier e, i.e. 

rij = sup (e), e). (12) 

£ 

Finally, the fuzzy ESS set S can be defined as 

H§(i) = minrjj. (13) 

The membership function value n§(i) describes the degree to which the strategy 
Si possesses the characteristic of ESS. The strategies can be ranked according 
to their membership. Strategies with a higher membership are evolutionarily 
stronger than those with a lower membership. 


2.3 Relation between Fuzzy ESS and Fuzzy Nash Equilib¬ 
rium 


In this subsection, the relation between the proposed generalization of the ESS 
and fuzzy Nash equilibrium mi is studied. In this regard, we review the Nash 
equilibrium concept and its fuzzy generalization, as in the following. 

The concept of Nash equilibrium [2] is a cornerstone of non-cooperative game 
theory. A strategy combination is called a Nash equilibrium (NE), if no player 
can do better by unilaterally changing his strategy. In other words, every player 
adopts his best response to the strategies of the other players. 

Definition 2: For a strategic game G = (N, {Si), (Si)), a strategy combina¬ 
tion (sf, $ 2 , * ■ *, s n) € EUiv Sj a NE if for every i £ N and every Si ^ s* £ Si, 


Si(*i ■ • • «,* • • ■ <) > $i(«I ■ • • 8*-!, Si, s* +1 ...s*) 


(14) 
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For instance, ( D,D) is the unique NE in prisoner’s dilemma game, and is 
also called a symmetric NE because of the symmetry of the strategy pair. 

In El, the authors proposed an interesting approach on finding degree of 
being NE of each strategy combination in fuzzy payoff games. Specifically, 
each strategy combination (si, S 2 , ■ ■ ■, s n ) has a possibility of being NE with the 
degree 

M Nash (si, Sn) = min ( min ( SF($ i (s 1 ... s*... s n ) 

VteN \vs'^SiGS« v 

^ • - • Si — 1, S^, . . . X n )^ j . (Id) 


Although ESS and NE were proposed in quite different settings, there exists 
a well established relation between ESS and symmetric NE in symmetric two- 
player games. That is, the symmetric NE set contains the ESS set [3]. In this 
paper, we show that there is a similar relation between fuzzy ESS and fuzzy 
symmetric NE, as follows. 

Theorem 1: In a symmetric two-player fuzzy game G, the fuzzy symmetric 
NE set contains the fuzzy ESS set, i.e. for every i £ {1,2,..., 151}, 


^NashiSi, ^ Mg(^ 0 * 


Proof: According to Equation. (fT5l) . 


HNa S h{si,Si) = min ^nun5F^$ 1 (s i ,s i ) > $ 1 (s J -,s l )^, 
in SF($ 2 {si, Si) > $ 2 (si,Sj))J 

in SF($(si,Si) > ${sj,Si )), 


mm; 


= mm 1 mm, 


minS’FI $(sj, Sj) > $(s,-, s* 


l SF($(si,Si) > $(sj,Si)^. 
According to Equations 1111121 and [131 


= mm; 


Ate(si) = m ins u p m i n ( inf SF(E l f (e) > e) 

e e£(0,e) 

^minsup inf SF(EV (e) > EVfts)) 

£ ee(O.E) 

= min5F(^(0)>^(0)) 

JiF' t 

= min SF($(si,Si) > $(sj,Si)). 


Thus 


l^Nash^Sii Si) f-lg(Si). 


(16) 


(17) 


(18) 

(19) 
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Figure 1: The membership function of a symmetric triangular fuzzy number 
T{a,b) 


As a result, the proposed fuzzy set of ESS can be considered as a refinement 
of the concept of fuzzy NE in m- 


3 Numerical Results 

In this section, we present two examples to illustrate the proposed approach. 
Specifically, in m, a two-player game with fuzzy payoffs were used to evaluate 
the fuzzy Nash equilibrium. The row player’s payoffs of that game are collected 
in Table [0 and is considered as the first example of a symmetric two-player 
game. The column player’s payoffs are collected in Table [H and is considered 
as the second example. For instance, for the firsr exaple, the payoff of a player 
when he plays Si and his oponent plays S 2 is $(1, 2) = T(6,1). T(a, b ) denotes a 
symmetric triangular fuzzy number with the center on a and boundaries on a±b. 
Fig. CD shows the membership function of T(a,b). Multiplication and addition 
involving symmetric triangular fuzzy numbers using the extension principle are 
considerably simplified. Let T(a,b) and T(a',b') be two symmetric triangular 
fuzzy numbers, and c be a positive real number. Then 

c ■ T(a,b) = T(ca, cb), (20) 

T(o, b) + T(a', b') = T{a + a',b + If). (21) 

Hence the expected payoffs E l f (e) and E^ (e) in Eq. © and © are also 
symmetric triangular fuzzy numbers. 


Table 1: Payoff matrix of the first example 



S 1 

S2 

S3 

Sl 

T(5,l) 

7X6,1) 

7X5,2) 

S2 

T(3,l) 

7X3,2) 

7X3,1) 

S3 

T( 4,1) 

7X5,2) 

7X7,1) 
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Table 2: Payoff matrix of the second example 



Si 

S2 

S3 

Si 

T( 3,2) 

n i,i) 

T{ 4,2) 

S2 

T(3,l) 

T(4,l) 

T( 3,2) 

S3 

T(3,1.5) 

T{ 3,2) 

T( 6,2) 



Figure 2: Membership functions of $(1,1), $(2,1), $(1, 2) and $(2, 2). 


In the first example, the degree of resistibility of the strategies against alter¬ 
native strategies are 


ri2 = 1 , 


r 13 = 0.397, 


r 2 i = 0, r 23 = 0.034, 

r 3 i = 0.603, r 32 = 0.966. (22) 


As a result, the fuzzy ESS set is as in equation l23l Hence, according to their 
membership, the strategies can be ranked as s 3 > si > s 2 . 


- 0.397 0 0.603 

S = -+ —+- 

SI s 2 s 3 


(23) 


Consider the situation in which a population playing strategy is invaded 
by a group of mutants playing s 2 . As can be seen in Fig. [2j the left boundary of 
$(1,1) is not smaller than the right boundary of $(2,1), and the left boundary of 
$(1, 2) is not smaller than the right boundary of $(2, 2). According to Equations 
l20l and EU the left boundary of (1 — e) • $(1,1) + e • $(1, 2) is not smaller than 
the right boundary of (1 — e) • $(2,1) + e • $(2, 2). That is, 

SF(E} 2 (e) > E%(e)) = 1. (24) 

Similarly, 

SF{E?{e)>E^{e)) = 0. (25) 

This explains the values of r 32 and r 2 i. 
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In the second example, the degree of resistibility of the strategies against 
alternative strategies are 


r 12 = 0.222, n 3 = 0.295, 

r 2 i = 0.778, r 2 3 = 0.349, 

r 3 i = 0.705, r 32 = 0.651. (26) 

As a result, the fuzzy ESS set is 

~ 0.222 0.349 0.651 , , 

S= -+-+-. (27) 

Si S 2 S 3 

According to their membership degree, the strategies can be ranked as s 3 > 
s 2 > Si. 

Table m summarizes the fuzzy ESS sets and the fuzzy symmetric NE sets 
of the two examples. For instance, /iNash(si, Si) = 0.958, ^Nash{s 2 , s 2 ) = 0, 
HNash{s 3 , s 3 ) = 0.989 in the first example. It can be seen that a strategy with 
a high degree of being an ESS also has a high degree of being a symmetric NE, 
while a strategy with a high degree of being a symmetric NE doesn’t necessarily 
have a high degree of being an ESS. This comparison result is congruous with 
the relation between fuzzy ESS and fuzzy symmetric NE. 


Table 3: Comparison between fuzzy ESS and fuzzy NE 



Sl 

s 2 

S3 

Fuzzy ESS of the first game 

0.397 

0 

0.603 

Fuzzy NE of the first game 

0.958 

0 

0.989 

Fuzzy ESS of the second game 

0.222 

0.349 

0.651 

Fuzzy NE of the second game 

0.5 

0.854 

0.958 


4 Discussion and Conclusion 

A key concept in evolutionary game theory is that of an evolutionarily stable 
strategy (ESS). It’s defined by comparison between an incumbent’s expected 
payoff and a mutant’s expected payoff. When the payoffs are represented by 
fuzzy numbers, the comparison results become vague, so there is no way to 
determine whether a strategy is an ESS. Although many works on fuzzy games 
have been done, there has been no generalization of ESS into a fuzzy one. 
Inspired by the recent work on fuzzy Nash equilibrium mi, this paper proposes 
a new approach to evaluate ESS in games with fuzzy payoffs. 

In this method, the possibility that an incumbent’s expected payoff is larger 
than a mutant’s, is a function of e (the invasion barrier). This function /Ltjj(e) 
incorporates the satisfaction function, which is also employed to compare two 
fuzzy payoffs in the fuzzification process of NE. Besides e is also an 


9 








indicator of population stability, hence the degree of resistibility of one strategy 
against another, denoted as r t j , is defined by using fuzzy decision rule on gij(s) 
and e. The membership function /. i§(i) is defined as the minimum of 

Since we used a similar point of view to fuzzy ESS as in m to the concept of 
fuzzy NE, the concept of fuzzy ESS has close relation to that of fuzzy NE. Just 
like crisp ESS can be considered as a refinement of crisp NE [3], fuzzy ESS can 
be considered as a refinement of fuzzy NE. It is worthwhile to note that both 
fuzzy NE and fuzzy ESS assign membership to pure strategies. The formaliza¬ 
tions of fuzzy NE and fuzzy ESS concerning mixed strategies are considerably 
complicated due to the continuity of mixed strategies. 

Also, we address the relation between crisp ESS and fuzzy ESS. Specifically, 
what if the proposed approach is applied to crisp payoff games? When the 
payoffs are crisp numbers, the expected payoffs of incumbents and mutants are 
the following crisp numbers: 

E) 3 {e) = (1 -e) • $(*,?)+£• $(«, j), (28) 

e Z( £ ) = (l-e)-S (29) 


In this regard, the satisfaction function for the comparison of crisp values k and 
l is defined as m 


SF(k > l) 

SF(k < l) 


'l, k>l 

< 0.5, k = l , 
0 , k < l 

( 1, k < l 

< 0.5, k = l ■ 

I 0 , k > l 


(30) 

(31) 


Hence, it is straightforward to verify that i', :] is equal to the supremum of £^ 
if £ij exists, and is equal to 0.5 if E \ 3 (e) = E^^e) for every e £ (0,1), and is equal 
to 0 in other cases. As an example, consider the Stag Hunt game that describes 
a conflict between safety and social cooperation. Two hunters go out on a hunt. 
Each can choose to hunt a stag or a hare (represented by strategies G and H 
respectively). A hunter who hunts hare obtains a payoff of h > 0. A hunter who 
hunts stag obtains a payoff of g > h if the other hunter also hunts stag, and 
obtains a payoff of 0 otherwise. Formally, F[) = $(H, G) = h , $(G, G) = g, 
and (G,H) = 0. According to the definition of crisp ESS, both G and FI are 
ESS. By contrast, the fuzzy ESS set for Stag Hunt is 


hs( H ) = p 

(32) 

hs(G) = 1 — 

(33) 


which gives a ranking of these two strategies. When h/g is small and ^§{G) > 
/Zg(-ff), the hunters tend to cooperate to hunt stag. When h/g becomes larger 
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and H§(H) > pg(G), the hunters tend to hunt hare to avoid the risk of being 
betrayed. In general, the membership function of a frizzy ESS set for strategy 
Si is reduced to the minimum of the invasion barriers of s,; against all Sj(j ^ i). 
In this way the idea of fuzzy ESS can be considered as a natural extension of 
the crisp ESS. 
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